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METHOD OF DETERMINING THE ROUTE OF PACKETS THROUGH A 
NETWORK OF COMMUNICATING OBJECTS 

FjLeld Qf the invention 
5 The present invention relates to computer 

networks and, more specifically, to methods which 
determine the route of packets through a network. 

PgLCkgypund tP thg invention 

10 Operators of communications networks often 

need to know the path that packets take between two 
points in a network. As an example, if an end user 
complains that he cannot get through to a particular 
server, the operator of that network needs to find out 

15 where the problem may be. If the problem is with a 

point on the network, the operator therefore needs to 
find the route packets from the end user travel toward 
the server in the network to properly diagnose the 
problem, 

20 Two scenarios where the routing of packets 

can be quite useful are in determining the performance 
of a network and in determining where the bottlenecks of 
a network may be- In the first scenario, the 
performance of specific routes can be determined if the 

25 routing can be found. In the second scenario, by 

listing each point in the route bottlenecks in the 
network can be found. However, while the solution and 
results can be found for both scenarios using other 
means, knowledge of the routes greatly simplifies the 

30 process. 

It should be noted that the term networks 
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includes wide area networks (WANs), local area networks 
(LANs), and many combinations thereof. For the purposes 
of this document, WANs are defined as collections of 
interconnected network routers bounded by LANs. A LAN 
5 is defined as a collection of interconnected non-router 

objects (including nodes, servers, and bridges) , each 
LAN being connected to other LANs by routers . 

For any given network, it is most 
advantageous if the topology of that network is known. 
10 Such knowledge would assist in the above routing 

determination problem. Fortunately, methods, such as 
those disclosed by Dawes et al in US Patent 5,926,462 
and US Patent 5,933,416, exist whereby the topology of a 
network of objects can be determined the disclosures of 
15 which are incorporated by reference. 

fQ From the above, there is therefore a need for 

^ methods to determine the route that a packet takes 

y through a network. Preferably, such methods would take 

- advantage of available processes such as those 

20 referenced above. 

□ Syinm^ry Qf thg Invention 

'^=^ The present invention meets the above need by 

providing methods which decompose a network into WAN and 

25 LAN segments. After the decomposition, the route is 

determined for each WAN and LAN segment. Often, the WAN 
path is unambiguously known from the topology of the 
network. For WAN segments where the path is ambiguous, 
the sequence of routers in the path from a source to a 

30 destination can be determined by the standard 

^'traceroute" method. This allows for the aggregation of 
multiple path sections to arrive at the full packet path 
through the WAN segment. For most LAN segments, the 
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path is unambiguously known from the topology. In LAN 
segments where the path is ambiguous, perhaps because of 
VLANs (Virtual LANs)/ every store and forward network 
element in the LAN segment tracks and can report the 
5 source addresses of packets which pass through it. By 

reading these records and noting which network element 
received a packet from a specific source address, the 
route of that packet can be mapped through that LAN 
segment . 

10 By combining the mapped path through multiple 

LAN segments with the full packet path through the 
different WAN segments, the full route a packet 
traverses through a network can be determined. 

Using the invention, not only can the packet 

15 routing through a network be found but the performance 

of specific portions of the network can be found as 
well. This can simplify the task faced by network 
operators and, ultimately, can improve the service 
provided to end users using the network. 

20 In one aspect the present invention provides 

a method of determining a routing for packets in a 
network, said method comprising: 

a) dividing said network into WAN (Wide Area 
Network) segments and LAN (Local Area Network) segments; 

25 b) determining a routing for packets through 

each segment; 

c) combining routing results obtained in step 
b) to obtain a total routing through the network. 


30 Brief Description of the Drawings 

A better understanding of the invention may 
be obtained by reading the detailed description of the 
invention below, in conjunction with the following 
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drawings, in which: 

Figure 1 illustrates a network on which the 
invention may be applied; 

Figure 2 is an illustration of a network of 
5 Figure 1 decomposed into LAN and WAN segments; and 

Figure 3 is a flow chart detailing the 
different steps in a method of the invention. 

Detailed Description of the Preferred Embodiment 
10 Referring to Figure 1, a network 10 is 

illustrated* As can be seen, the network 10 is composed 
of routers R1-R19 and non-router objects N1-N27, The 
non-router objects N1-N27 can be switches, hubs, network 
nodes, or any other device connected to a network, 
15 For clarity, it should be noted that each 

object, whether it be a router or not, may have multiple 
ports. Figure 1 shows the port number for each object 
next to its link. For example, non-router object N5 has 
4 ports: N5(l) (meaning object N5 port 1) connecting to 
20 N4(3), N5(2) connecting to N6(l), N5(3) connecting to 

N7(l), and N5(4) connecting to Rl(l). The table (TABLE 
1) below lists the connections in Figure 1 using the 
notation above. 

25 TABLE 1 


OBJECT PORT CONNECTED TQ 

Nl 1 N2 ( 1 ) 

N2 1 Nl(l) 

30 2 N4(2) 

N3 1 R19(2) 

2 N4(l) 

N4 1 N3(2) 

2 N2(2) 

35 3 N5(l) 

N5 1 N4(3) 

2 N6(l) 
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R18 
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2 
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R19 
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R18 (2) 

40 
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N3(l) 


To determine the route a packet takes in 
travelling from one point in the network 10 to another 
point in the same network, a niimber of constraints have 
45 to be placed on the route to be found, otherwise the 

process may become, if not untenable, then impractical. 
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These are: 

a) a path cannot pass through a broken device 
or interface; 

b) a path cannot pass through an interface 
5 which, although up, is carrying no traffic; 

c) a path cannot loop back on itself. 
Furthermore, it should be assumed that the 

topology or the interconnections between the different 
elements of the network, is known. This not only 

10 greatly simplifies the process but actually allows the 

process to be carried out. If the topology is not 
known, the methods described by Dawes et al in US Patent 
2,926,462 and US Patent 5,933,416 as noted above can be 
used to find the topology. For the purpose of this 

15 document, the topology of the network 10 is as shown in 

Figure 1 . 

With these constraints in mind, the first 
step in the process is to decompose the network 10 into 
router objects and non-router network objects. It 

20 should be clear from Figure 1 and from the above that 

objects R1-R19 are routers while objects N1-N27 are non- 
router objects. Based on this, the network 10 can then 
be divided into WAN segments and LAN segments. Since 
LAN segments are connected non-router objects bound by 

25 router objects, network 10 has five LAN segments 20, 30, 

40, 50, 60. Also, since WAN segments are interconnected 
router objects bounded by LAN segments, network 10 has 
three WAN segments 70, 80, 90. 

To assist in the understanding of the above, 

30 Figure 2 illustrates the interconnections between the 

LAN and WAN segments. Reference to Figures 1 and 2 
should make the discussion clear. LAN segment LANl (20) 
is composed of non-router objects Nl, N2, N3, N4, N5, N6 
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and N7. LAN segment LAN2 (30) is composed of non-router 
objects N8^ N9, and NIO. LAN segment LAN3 (40) is 
composed of non-router objects N21, N22, N23, N24, N25, 
N26, and N27. LAN segment LAN4 (50) is composed of non- 
5 router objects Nil, N12, N13, N14, N19 and N20. LAN 

segment LANS (60) is composed of non-router objects NIS, 
N16, N17 and N18. 

For the WAN segments, WAN segment WANl (70) 
is composed of router objects Rl, R2, R3, R4, R9, RIO, 
10 Rll, R12, R14, R15 and R16. WAN segment WAN2 (80) is 

composed of router objects R5, R6, R7, R8 and R17. WAN 
segment WAN3 (90) is composed of router objects R13, R18 
and R19. 

Also as can be seen from Figure 2, the router 

15 object connecting a LAN segment to a WAN segment is 

noted next to the link. Thus, as an example, router 
object R5 connects WAN segment WAN2 (80) to LAN segment 
LAN2 (30) while router object R17 connects LAN segment 
L7\N3 (40) to WAN segment WAN2 (80) . 

20 Assuming non-router object Nl is the source 

WJV^ of a packet and rout^er object N27 is the destination, 
the path must therefore be determined for each LAN or 
WAN segment the packet traverses. To find the sequence 
of routers the packet would traverse, non-router object 

25 Nl could use the well known and widely available 

traceroute function. This function, essentially a small 
utility program run by a node, records the sequence of 
routers passed through from the computer invoking the 
utility to a given destination. Thus, if non-router 

30 object Nl invokes the traceroute utility, the sequence 

of routers could be: 

R1-R4-R9-R11-R12-R15-R16. 
If this was the sequence returned, and based on the 
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known topology of the network 10, it can be seen that 
only WAN segment WANl (70) is traversed. However, if 
the sequence returned were as follows: 
R1-R2-R3-R5-R7-R8-R17 
5 then, again using the knowledge of the topology, the 

route traverses not only WAN segment WANl (70) but also 
WAN segment WAN2 (80) . This is because routers R5, R7, 
R8 and R17 are in WAN segment WAN2 while the other 
routers are in WAN segment WANl, Also, since WAN 
10 segment WAN2 is traversed, it is clear that the path 

through LAN segment LAN2 must also be determined in 
addition to the routing through LAN segments LANl (the 
source LAN segment) and LAN3 (the destination LAN 
segment) 

15 If, for the purposes of this example, the 

traceroute utility returned the first sequence of the 
routers, the sequence which only traverses WAN segment 
WANl, we therefore know the route through the WAN 
segment. To determine the route through LAN segments 

20 LANl (20) and L7\N3 (40), each non-router element in 

those LAN segments would have to be queried. Each non- 
router network object, whether it is a switch or hub, 
keeps a record (in a table) of the source MAC (Media 
Access Control) address of the packets which transit 

25 through it. Thus, by examining these tables, it can be 

determined which network object receives packets from 
which source network object. 

As an example, the table below (Table 2) 
shows some of the non-router objects of LAN segment LANl 

30 (20) and the source MAC addresses of packets these 

objects have received. 
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LANl Object 

Source MAC 


ajQcl Port 

Mdress cinci Packets 

5 

N1{1) 

N2, N3, N5, N6, N7, N4 
Rl, R19 


N2{1) 

Nl 


N2 (2) 

N4, N5, N7, Rl, R19 


N3(l) 

R19 

10 

N3 (2) 

Nl, N2, Rl, N4, N5 


N4 (1) 

N3, R19 


N4 (2) 

Nl, N2 


N4 (3) 

Rl, N5, N6, N7 


N5(l) 

R19, N3, N4, Nl, N2 

15 

N5 (2) 

N6 


N5(3) 

N7 


N5 (4) 

Rl 


From the table above, non-router object Nl 

20 can be "seen" by non-router objects N2, N3, N4, N5, N6, 

and N7 . This is because each of these objects can 
receive packets originating from Nl . (E.g. N2 can 
receive it through N2{1), N3 can receive it from N3(2), 
etc) . The objects traversed by a packet from Nl 

25 (source) to Rl (interim destination) are the objects 

which can receive packets from Nl, N3, N6 and N7 while 
capable of receiving packets from Nl, is, from the 
topology of the LAN segment, clearly not on the route 
from Nl to Rl . Since it is known that N2 is the only 

30 link to Nl, then N2 must be on the path. Also, since it 

is known that N4 is the only link to N2, then N4 must be 
on the path as well. 

Because N3 is not connected to Rl and since 
there is no link from N3 to N5 without going through N4, 

35 then N3 is not on the path from Nl to Rl , We can see 

that N5 is the only link to Rl - N5 must therefore on 
the path from Nl to Rl . 

Thus, from the topology and Table 2, a 
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packet must travel from Nl to Rl (since Rl is the first 
router encountered travelling from Nl to N27 as 
determined from the sequence of routers using traceroute 
above) via the following objects and ports: 

5 

Nl (1) ->N2 (1) ->N2 (2) ->N4 (2) ->N4 (3) ->N5 (1) ->N5 (4) ->R1 (1) . 


The analysis therefore looks for a route from 
within the LAN segment going to a destination (albeit 
10 interim) that is external to the LAN segment. 

Once the packet has entered router Rl, it has 
effectively left LANl and is in WANl . 

At this point, it is already known what 
sequence of routers that packets traverses through WANl . 
15 What is therefore needed is the path from WANl to LAN 

segment LAN3 (40) and the path within LANS. Again, each 
object in LAN3 would have to be queried for its MAC 
source address table entries. If we take these as 
follows : 

20 

TABLE 3 

LAN3 Object 
and Port 

25 N21(l) 

N21 (2) 
N21 (3) 
N22 (1) 
N22 (2) 

30 N23{1) 

N23 (2) 
N23 (3) 

N24 (1) 

35 

N24 (2) 
N25 (1) 
N25(2) 
N2 6 (1 ) 


Source MAC 
Address 

R16 

N22, N26 

N23, N24, N25, R17, N27 

N21, R16 

N26, N27 

N24, R17 

N21, R16 

N25, N27 

N23, N25, N21, R16, N27, 

N22, N26 

R17 

N23, N21, R16, N24, R17 
N27 

N22, N21, R16 
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N27(l) N16, N21, N23, N25, R17, 

N24, N22, N26 

For this LAN segment, the analysis is the 
5 converse of that for LANl . While in LANl the route was 

from within the LAN segment to a point external to the 
LAN segment, for the destination LAN segment to a point 
within the LAN segment. Thus, router R16 must be 
treated as the source MAC address and objects which can 

10 "see" R16 are of interest. From TABLE 3, these objects 

are N21, N22, N23, N24, N25, N26, and N27 . Since N21 is 
the only route to the router, N21 must be on the path. 
From the topology, N25 is the only link to N27 so N25 
must be on the route to N27, Since N23 connects (again 

15 from the topology) N21 and N25 (both of which are on the 

route) then N23 must be on the route as well. Thus, the 
sequence of non-router objects traversed when travelling 
from R16 to N27 is as follows: 

20 R16 (2) ->N21 (1) ->N21 (3) ->N2 3 (2 ) ->N25 ( 1 ) ->N25 (2) ->N27 (1) . 

Since we now have the route through LANl, 
WANl, and LAN3, these paths can be put together to 
arrive at the full path from Nl to N27: 

25 

LANl: N1->N2->N4->N5 -> WANl 

WANl: R1->R4->R9->R11->R12->R15->R16 LAN3 
LAN3: N21->N23->N25->N27 

30 It should be noted that, once a packet leaves 

a WAN segment and enters a LAN segment, that packet's 
source MAC address becomes the exit port of the last 
router it went through. Thus, a packet from Nl to NIG 
will have a source MAC address of Nl as it travels 
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through LANl . However, once that packet enters LAN2, 
its source MAC address becomes R3, this being the last 
router that it exited. 

It should be also be noted that path 
5 ambiguities, especially in LAN segments, can sometimes 

be resolved by logic. For example, if a packet is 
leaving object N12 (source) to arrive at router R14 but 
none of the ports of object N14 report seeing packets 
from object N12, it should be clear that object N14 is 

10 on the path. This is because N14 must be on the path to 

pass the packet through to either N19 or N20 and 
subsequently to R14. 

Determination of the path through LAN 
segments therefore requires repeated readings of the 

15 source address capture information from devices/objects 

in that LAN segment. This can be accomplished using the 
Simple Network Management Protocol (SMNP) . 

While the above example found the path from 
Nl to N27, the return path, with N27 as the source and 

20 Nl as the destination, may not be the same. Such a path 

may traverse the network from LAN3 to WAN2 to WANl and 
finally to LANl. Determining this path would involve 
finding the path through the different LAN segments 
(LAN3, LAN2, and LANl) and the different WAN segments 

25 (WAN2 and WANl) . 

While the method outlined above can determine 
the path from a specific source to a specific 
destination, it would be difficult to determine the path 
from an arbitrary source to an arbitrary destination, 

30 especially if a control computer were not the source. 

If, again with reference to Figure 1, Nl was the control 
computer and the path from N17 to N24 were required, it 
would be quite difficult for Nl to find this path. 
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However, if specific objects were designated 
as beacon objects, these beacon objects could find the 
data required and report such data back to the control 
computer. A beacon object is essentially a network 
5 object, usually a non-router object, which traces paths 

through the network and reports these paths to the 
control computer. Designating and using a beacon object 
can be as simple as having the control computer send 
instructions to a network object A to perform a 
10 traceroute from itself, object A, to another network 

object B. The network object A will then perform this 
duty and, once the results of the traceroute function 
have been received, sends this result to the control 
".Q computer. As an example, if N16 were designated as a 

15 beacon object, it could determine a path from itself 

Co {N16) to the destination (N24) . Since N17 is only one 

'•a, 5 

Si link away from the beacon, the path from N17 would 

y simply be the path from the beacon (N16) to the 

f destination (N24) plus the hop from N17. Similarly, if 

n 20 one wished to find the route from R5 to R17 (the path 

being ambiguous at R5), NIG could be designated as a 
p beacon. By executing the traceroute function from NIG 

to R17, this ambiguity may be resolved. This is 
because a packet travelling from NIO to R17 must transit 
25 through R5 and either R6 or R7 . 

For optimal placement of beacon objects, the 
topology of the network and the location of the source 
or destination objects must be taken into account. If a 
LAN segment interconnected two segments through which 
30 the path passed, a beacon placed in that interconnecting 

LAN segment would be very advantageous. Thus, from 
Figure 2, if the source was in IiAN4 (such as N19) and 
the destination was in LAN3 (such as N25) with R16 not 
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carrying any traffic or is down, the only route would be 
LAN4->WAN1->LAN2->WAN2->LAN3. A beacon placed in LAN2 
could prove very helpful in finding this path. 
Alternatively, if a LAN segment contained at least one 
5 source or destination, a beacon in that LAN segment 

would also prove advantageous. For example, if the 
source was N13 and the destination was N2 with router Rl 
down or inoperative, beacons could be placed at N14, 
N16, and N4 . N14 would prove advantageous as it is in 

10 the same LAN segment as the source. N16 is in a LAN 

segment connecting two WAN segments (WANl and WAN3) , 
while N4 is in the same LAN segment as the destination. 

Once the routing from a source to a 
destination has been determined, the performance of that 

15 route can be measured. Because the specific objects 

traversed in travelling from a source to a destination 
is known, the overall performance of that route is 
merely a function of the individual performance of each 
of these objects. 

20 More specifically, using known methods, such 

as those discussed in the Canadian application No. 
2,196,133 and in US application serial no. 09/599,963, 
the disclosure of which are incorporated herein by 
reference, the end to end performance of a path can be 

25 easily found. One possible performance measure for a 

path is the end to end transmission fraction over a 
specific path. This measures what fraction of packets 
are actually transmitted from a source to a destination. 
If we define D(i) as the drop rate on a device (if 

30 D(A)=0.12, this means 12% of packets are lost while 

transmitting through device A) and T as the end to end 
transmission fraction over a path from the object 1-N, 
then 
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r= n (1 -£»(/•)) 


Another performance measurement which may be 
used is that of end to end delay. By determining the 
delay through each network element, through known 
5 methods, and aggregating such delay measurements for a 

specific path, the end to end delay for that path can be 
found. 

A further performance measurement is that of 
end to end availability- By finding the break state or 
10 availability of each network element, again from known 

methods, and then applying the above method for finding 
a specific path to these, the end to end availability of 
the path can be found. 

From the above end to end performance 
15 measurements and from the performance measurements of 

the individual network element, bottlenecks within the 
network can be found. If one knows the end to end 
performance of a path and the performance of the 
individual network elements, bottlenecks can be 
20 pinpointed — whichever network element has the highest 

performance measurement or the most throughput is most 
likely the bottleneck. 

These and other performance measurements can 
therefore be found more easily using the path 
25 determining method above. 

To clarify the method outlined above. Figure 
3 illustrates a flowchart detailing the steps executed. 

Beginning at the BEGIN box 100, box 110 notes 
that the objects in the network must be determined if 
30 they are router objects or non-router objects. In box 
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120, the network is decomposed in LAN and WAN segments • 
Box 130 notes that all routers must be grouped into WAN 
segments. Each WAN segment must be bounded by or 
regenerated from other WAN segments by at least one non- 
5 router object. Once the WAN segments have been grouped, 

box 140 notes that the sequence of routers from the 
source to the destination must be found. As noted 
above, the well known traceroute function can be used 
for this. Well placed beacon objects in the network can 

10 be used for the traceroute step if required. The step 

in box 150 is optional as evidenced by the dashed box 
around it. Step 150 would be most useful if the path 
traversed multiple WAN segments, such as if the path led 
through WANl and WAN2 in Figures 1 and 2. If, however, 

15 the path only led through a single WAN segment, beacons 

may not be required. 

Once the path is determined through the WAN 
segments, any intervening LAN segments interconnecting 
the WAN segments must be resolved. (E.g. if the path 

20 led through WANl, WAN 2, and LAN2 in Figure 2, the path 

through LiAN2 would have to be found) . (See box 160) . 

It should be noted that the step in box 170, 
that of grouping the non-router segments into LAN 
segments, can be executed concurrently with the step in 

25 box 130. However, in the beginning of the process, the 

only known LAN segments are the LAN segments of the 
source and the destination. Thus, the two LAN segments 
would be the first ones grouped. Any interconnecting 
LAN segments between WAN segments can be grouped 

30 subsequently. 

The next step is that shown in box 180 - that 
of reading the source address tables for the objects in 
the subject LAN segment. This is done to find out which 
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object in that LAN segment receives or "sees" the 
relevant source MAC address. For the LAN segment to 
which the source object belongs, the relevant MAC 
address would be the MAC address of the source object. 
5 For any other LAN segment, the relevant source MAC 

address would be the MAC address of the router from 
which the packet entered the LAN segment. As an 
example, from Figure 1, if the router sequence was 
R14-R15-R16 and then N21, the relevant source MAC 
10 address for the LAN segment LAN3 would be the MAC 

address of router R16 and, more specifically, the MAC 
address of port 2 of router R16. 

Once the source MAC address tables have been 
g read, box 190 notes that path through the LAN segment 

15 must be found, 

g By knowing which objects '"see" the relevant 

^ MAC and which objects are interconnected, the path from 

y one point in a LAN segment to another in the same LAN 

segment can generally be determined. (See box 200) . In 
3 20 case of ambiguities, logic can be used to find a 

^ reasonable path. If the ambiguity cannot be resolved, 

3 user intervention may be required. 

^ Decision 210 determines if there are more LAN 

segments to be analysed. These LAN segments may have 

25 resulted from the step in box 160. If there are more 

LAN segments, these are immediately analysed in the loop 
formed by boxes 180, 190, 200, 210. 

If there are no more LAN segments to be 
examined, this means that the path has been found. The 

30 final step (box 220) is to combine the paths found in 

the individual WAN and LAN segments into a coherent 
whole. By combining multiple segments, the path through 
any combination of LAN and WAN segments can be found. 
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The invention described above is ideally 
implemented with the use of a single control computer 
which instructs multiple beacons in the network. By 
using this scheme, each beacon can act as the source to 
5 determine the path to and from arbitrary points in the 

network. The beacons then report their findings to the 
control computer. From Figure 1, if the control 
computer was object N17 and the beacons were objects N2, 
N9, N13, and N21, most paths can be found. If the path 

10 from N4 to N8 were desired, N2 can act as the source. 

By simply removing the hop from N4 to N2, the path found 
is the path from N4 to N2. Similarly, if the path from 
N20 to N15 were desired (and assuming that a direct path 
existed between N13 and N14), then N13 can act as the 

15 source. The hops from N20 to N13 can be removed from 

the resulting path to find the desired path from N20 to 
N15. 

A person understanding the above-described 
invention may now conceive of alternative designs, using 
20 the principles described herein. All such designs which 

fall within the scope of the claims appended hereto are 
considered to be part of the present invention. 


25 
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